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(54) Three-dimensional image display device 

(57) It is possible to provide a three-dimensional im- 
age display device which can improved a final resolution 
balance and can prevent display blocking. A three-di- 
mensional image display device includes: a two-dimen- 
sional image display device where pixels (4) constituting 
a pixel group displaying an elemental image are ar- 
ranged in a matrix shape; and an optical plate (6) which 
has exit pupils (7) corresponding to the pixel group and 
controls light rays from the pixels of the pixel group, 
wherein the exit pupils in the optical plate are constituted 
so as to be continued in an approximately vertical direc- 
tion, and an angle (6) formed between a direction in 
which the exist pupils are continued (L) and a column 
direction (Y) of a pixel arrangement in the two-dimen- 
sional image display device is given by arctan (1/n) 
when n is a natural number which is different from mul- 
tiples of 3. 
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Description 

BACKGROUND OF THE INVENTION 
5 Field of the Invention 

[0001] The present invention relates to a three-dimensional image display device which can display a three-dimen- 
sional image. 

10 Related Art 

[0002] Three-dimensional (3-D) image display techniques are classified to various types. When a 3-D image is dis- 
played without using glasses by multiview system, holography, or integral photography system (hereinafter, called "IP 
system"), for example, the following constitution may be employed. That is, a plurality of pixels for a two-dimensional 

15 image display arranged two-dimensionaily constitute each of pixels for a 3-D image display, and an optical plate is 
arranged on a front face of the pixels for a 3-D image display. In the optical plate, an exit pupil designed to be capable 
of taking only image information or data included in one pixel for a two-dimensional image display from the pixel for a 
three-dimensional image display is provided for each of pixels for a three-dimensional image display. That is, a viewer 
can view a three-dimensional image as an autoslereoscopic view without using glasses by partially shielding pixels 

20 for a three-dimensional image display with the optical plate and making pixels for a two-dimensional image display 
observed by the viewer through exit pupils different at each viewing position. 

[0003] In a detailed explanation about the IP system, an image displayed on a pixel for a three-dimensional image 
display is called "an elemental image". The elemental image corresponds to a pin-hole camera image shot through a 
pin hole replacing the exit pupil. 

25 [0004] Incidentally, an electronic device is lower in resolution than a silver film for a pin hole camera in the existing 
circumstances, and the term "elemental image" used in this text simply expresses a collection of pixels constituting 
plural two-dimensional images with different shot angles. That is, of elemental images displayed on individual pixels 
for a three-dimensional image display with the above constitution, namely, of a collection of constituent pixels for two- 
dimensional images (parallax images) shot in a plurality of different directions, only image information pieces coincident 

30 with an observing direction of a viewer, namely, only image information pieces which should be viewed when a three- 
dimensional image is actually present are viewed. 

[0005] A difference between the multiview and the IP system occurs due to a low resolution of an electronic device. 
Though shooting angles for elemental images should be continuous ideally, they become discrete necessarily due to 
lack in resolution of an electronic device. In this case, the multiview system is designed such that lines connecting exit 
35 pupils and pixels, namely, light rays emitted via exit pupils are converged at a viewing distance, on the other hand, the 
IP system is not provided with a converging point of light rays. 

[0006] In a binocular system is a three-dimensional image displaying system which adopts such a design that two- 
dimensional images acquired at respective shooting positions in a perspective projection manner are converged at a 
pair of points spaced from each other by an inter-eye distance (about 65mm). According to this design, a viewer can 

40 view individual images (respective two-dimensional images shot at two shooting positions) with his/her right eye and 
left eye without using glasses at a position where he/she is spaced from a screen by an observation viewing distance 
L. Further, in a state that at least two pairs of converging points of light rays are arranged in side by side, an image 
observed with the left eye of a viewer and an image observed with his/her right eye are switched according to movement 
of a viewing position toward a left and/or a right direction. Accordingly, the viewer can confirm an aspect that a three- 

45 dimensional image varies according to movement of the viewing position. 

[0007] On the other hand, the IP system is a three-dimensional image display system adopting such a design that 
two-dimensional images shot at respective shooting positions are not converged at one point. For example, such a 
design is employed that, assuming that a viewing position is spaced from a display plane by infinity, images observed 
with one eye of the viewer is switched to respective images shot at a plurality of shooting positions according to change 

50 in viewing angleTln a representative example, an image for three-dimensional image display can be produced using 
an image shot according to an parallel. projection method by employing such a design that light rays emitted from 
different exit pupils become parallel. 

[0008] According to such a design, since observation is not performed physically from a position spaced from a 
display plane by infinity, a two-dimensional image viewed with a viewer's one eye does not become equal to a two- 
55 dimensional image shot at any shooting position. However, a two-dimensional image observed with a viewer's right 
eye and a two-dimensional image viewed with his/her left eye are each constituted by summing images shot from a 
plurality of directions by an parallel projection method, so that they averagely become two-dimensional images shot 
from a viewing position by a perspective projection method. With such a constitution, individual images can be viewed 
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with the right eye and the left eye, and a three-dimensional image which a viewer perceives becomes equivalent to a 
three-dimensional image recognized when the viewer actually observes a shot object from either direction. That is, the 
viewing position is not assumed in the IP system. 

[0D09] Regarding the IP system, the multiview system, and further a dense multiview system where converging 

s points are provided at a pitch shorter than an inter-eye distance, differences among them in occurrence of display 
blocking generated due to a non-display portion in a two-dimensional image display device will be explained. 
[0010] According to the above-described constitution, in the IP system, a position of a pixel appearing via an exit 
pupil when observation is performed from one point at a viewing distance is unstable. That is, a position where a pixel 
is observed varies periodically for each exit pupil. In the IP system, therefore, exit pupils which can view a non-display 

10 portion (a boundary between pixels) distribute within a screen periodically and they are viewed as a luminance change 
within the screen. On the other hand, since the multiview system is designed such that light rays converge at a viewing 
distance, the same position of a pixel can be viewed from all exit pupils when viewing is performed at one point at the 
viewing distance. Since the number of pixels converging rays is reduced to 1/n, even when the same position in a pixel 
is observed from exit pupils of 1/n all exit pupils, even in the dense multiview system where the number of converging 

is points of light rays has been increased to n times thereof. That is, in the IP system, a non-display portion can not be 
viewed Irom each exit pupil at all. Alternatively, such a state where only the non-display portion can be viewed from 
all the exit pupils occurs. In other words, a luminance unevenness or moire occurring due to a non-display portion 
within a screen in the IP system occurs as luminance distribution unevenness in a space where a viewer is present in 
the multiview system. In the dense multiview system where a non-display potion can always be viewed at a constant 

20 ratio to movement of a viewing position in a horizontal direction by reducing the number of exit pupils which can view 
a pixel center at a viewing distance to 1/n and increasing the number of the converging points of light rays to n times, 
luminance change in a space at the viewing distance can be suppressed, but unless an aperture. ratio of a two-dimen- 
sional image display device or an aperture ratio of an exit pupil (a window portion) in an optical plate is controlled, the 
luminance change can not be removed completely (for example, refer to US Patent 6,064,424). 

25 [0011] In each system of the IP system, the multiview system, and the dense multiview system, since a plurality of 
pixels for a two-dimensional image display is used to constitute a pixel for a three-dimensional image display, a reso- 
lution of a three-dimensional image to be reproduced becomes lower than an original resolution of an electronic device. 
For purpose of suppressing such a resolution reduction, a method which provides only parallax information or data 
pieces in a horizontal direction which is effective for acquiring a stereoscopic feeling has been already studied (a one- 

30 dimensional IP system and a one-dimensional multiview system). In this case, exit pupils in an optical plate are formed 
so as to be continuous in a vertical direction and elemental pixels are developed only in a horizontal direction. That 
is, the parallax information pieces are not provided in the vertical direction. Regarding the resolution reduction in the 
horizontal direction, such a method has been studied focusing attention on a pixel arrangement in an electronic device 
such as an LCD that a resolution in a vertical direction is decreased to 1/3 but a resolution in a horizontal direction is 

35 increased to three times by handling a triplet of RGB adjacent to one another vertically as one pixel instead of con- 
ventionally handling a triplet of RGB adjacent to one another horizontally as one pixel (for example, refer to JP-A- 
10-253926). 

[0012] As described above, in addition to the problem about the resolution lowering, there is the problem about the 
display blocking due to a non-display portion of a two-dimensional image display device generated by an action between 

40 the non-display portion and an optical plate. Regarding this problem, USP 6,064,424 has proposed that an optical plate 
is inclined for solving the display blocking and improving a resolution balance in a three-dimensional image display 
device of a multiview system. By inclining the optical plate, a region where a non-display portion can be observed at 
the viewing distance is dispersed spatially, so that a luminance change can be suppressed. However, since the non- 
display portion in the electronic device is not formed in a vertical stripe shape but in a grating shape, it is necessary to 

45. incline a lens and control a numerical aperture of an exit pupil (a window portion) in an optical plate in a two-dimensional 
image display device strictly in order to suppress the luminance change due to the non-display portion completely. 
Further, since the vertical resolution can be distributed to the horizontal resolution to a certain extent by inclining the 
optical plate, a method for improving deterioration in resolution balance by providing parallax information pieces only 
in the horizontal direction has been described in USP 6,064,424. 

so [0013] However, it can not be perceived from the following reason that the resolution balance has been improved 
sufficiently. When a three-dimensional image is displayed by distributing a plurality of parallax images which are view- 
able regions in such a system as the IP system or the multiview system, such a problem arises that a resolution in the 
three-dimensional image display device lowers from an original resolution in an employed two-dimensional image 
display device due to a constitution of the system and the display blocking occurs due to the non-display portion. 

55 

SUMMARY OF THE INVENTION 

[0014] The present invention has been made in view of these circumstances, and an object thereof is to provide a 
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three-dimensional image display device which can improved a final resolution balance and can prevent display blocking. 
[001 5] A three-dimensional image display device according to a first aspect of the present invention includes: a two- 
dimensional image display device where pixels constituting a pixel group displaying an elemental image are arranged 
in a matrix shape; and an optical plate which has exit pupils corresponding to the pixel group and controls light rays 
5 from the pixels of the pixel group, wherein the exit pupils in the optical plate are constituted so as to be continued in 
an approximately vertical direction, and an angle formed between a direction in which the exist pupils are continued 
and a column direction of a pixel arrangement in the two-dimensional image display device is given by arctan (1/n) 
when n is a natural number which is different from multiples of 3. 

[0016] The standard number of parallaxes N can be given by square n 2 of the natural number n. 
10 [0017] It is preferable that n is a natural number of 4 or more. 
[001 8] It is preferable that n is 4 or 5. 

[0019] A ratio of a horizontal resolution to a vertical resolution in a three-dimensional image can be coincident with 
a ratio of a horizontal resolution to a vertical resolution in the two-dimensional image display device. 
[0020] A pixel region constituting the elemental image can be formed in an approximately square shape. 
is [0021] A formation region of the elemental image can be an approximately square region of n rows x n columns, 
and RGB sub-pixels having the same parallax number can be positioned over three rows of the n rows forming the 
elemental image, which are different from one another. 

[0022] A formation region of the elemental image can be an approximately square region of n rows x n columns, 
and RGB sub-pixels having the same parallax number can be posilioned over three columns of the n columns forming 
20 the elemental image, which are different from one another. 

[0023] Three sub-pixels of R, G s and B whose positions viewed through the exit pupils are close to one another of 
a plurality of sub-pixels forming a pixel region displaying the elemental image can be grouped and attached with the 
same parallax number. 

[0024] When arrangements of RGB sub-pixels having the same parallax number belong to different elemental image, 
25 the arrangements can be the same. 

[0025] When m and I are positive integers, arrangement of RGB sub-pixels having parallax number m and arrange- 
ment of RGB sub-pixels having parallax number (m -»- n x 1) can be the same. 

[0026] When a plurality of elemental images are viewed through a single column extending over the plurality of 
elemental images, the parallax number continuously can increase upwardly from 1 to N and the increase can be re- 
30 peated. 

[0027] A three-dimensional image display device according to a second aspect of the present invention includes: a 
two-dimensional image display device where pixels constituting a pixel group displaying an elemental image are ar- 
ranged in a matrix shape; and an optical plate which has exit pupils corresponding to the pixel group and controls light 
rays from the pixels of the pixel group, wherein the exit pupils in the optical plate are constituted so as to be continued 
35 in an approximately vertical direction, and an angle formed between a direction in which the exist pupils are continued 
and a column direction of a pixel arrangement in the two-dimensional image display device is given by arctan (1/n) 
when n is a natural number which is different from 3, and the standard number N of parallaxes is given by square n 2 
of the natural number n 

[0028] It is preferable that n is a natural number of 4 or more. 

40 [0029] The standard number N of parallaxes can be 1 6 or 25. 

[0030] A three-dimensional image display device according to a third aspect of the present invention includes: a two- 
dimensional image display device where pixels constituting a pixel group displaying an elemental image are arranged 
in a matrix shape; and an optical plate which has exit pupils corresponding to the pixel group and controls light rays 
from the pixels of the pixel group, wherein the exit pupils in the optical plate are constituted so as to be continued in 

45 an approximately vertical direction, and an angle formed between a direction in which the exist pupils are continued 
and a column direction of a pixel arrangement in the two-dimensional image display device is given by arctan (1/n) 
when n is a natural number of 4 or more. 



so 



BRIEF DESCRIPTION OF THE DRAWINGS 
[0031] 



Fig. 1 is a diagram showing pixel columns and inclination angles of a region observed by a single eye via a single 
exit pupil in an optical plate in a two-dimensional image display device in a three-dimensional image display device 
55 according to one embodiment of the present invention; 

Fig. 2 is a diagram for explaining an outline of the three-dimensional image display device according to the em- 
bodiment of the invention; 

Fig. 3 is a diagram showing pixel columns and inclination angles of a region observed by a single eye via a single 
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exit pupil in an optical plate for a two-dimensional image display device in a conventional three-dimensional image 
display device; 

Fig. 4 is a view showing arrangement of RGB sub-pixels when the three-dimensional image display device ac- 
cording to the embodiment is observed with a single eye; 

Fig. 5 is a view showing arrangement of RGB sub-pixels when the conventional three-dimensional image display 
device is observed with a single eye; 

Figs. 6A and 6B are diagrams showing characteristics according to one embodiment of the invention, Fig. 6A being 
a diagram showing arrangement of parallax images on a display element using a color filter with a stripe arrange- 
ment when an inclination of a single exit pupil in an optical plate is set to arctan (1/4) and Fig. 6B being a diagram 
showing relative positions among a plurality of elemental images; 

Fig. 7 A and 7B are diagrams showing characteristics according to one embodiment of the invention, Fig. 7 A being 
a diagram showing arrangement of elemental images on a display element using a color filter with a stripe arrange- 
ment when an inclination of a single exit pupil in an optical plate is set to arctan (1/4) and Fig. 7B being a diagram 
showing an appearance of an optical plate combined with the elemental images shown in Fig. 7A; 
Fig. 8 is a diagram showing how to distribute, to a three-dimensional image display device, pixel information pieces 
constituting a parallax image acquired trom a plurality of different directions at a low resolution by an parallel 
projection when an inclination of a single exit pupil in an optical plate is set to arctan (1/4) in a three-dimensional 
image display device according to one embodiment of the invention; 

Fig. 9 is a diagram showing arrangement of parallax images on a display element using a color filter with a mosaic 
arrangement when an inclination of a single exit pupil in an optical plate is set to arctan (1/4) in a three-dimensional 
image display device according to one embodiment of the invention; 

Fig. 10 is a diagram showing arrangement of a plurality of elemental images on a display element using a color 
filter with a mosaic arrangement when an inclination of a single emit pupil in an optical plate is set to arctan (1/4) 
in a three-dimensional image display device according to one embodiment of the invention; 

Figs. 11 A and 11 Bare diagrams showing characteristics according to one embodiment of the invention, Fig. 11 A 
being a diagram showing arrangement of parallax images on a display element using a color filter with a stripe 
arrangement when an inclination of a single emit pupil in an optical plate is set to arctan (1/5) and Fig. 11B being 
a diagram showing relative positions among a plurality of elemental images; 

Fig. 12 is a diagram showing arrangement of a plurality of elemental images on a display element using a color 
filter with a stripe arrangement when an inclination of a single exit pupil in an optical plate is set to arctan (1/5) in 
one embodiment of the invention; 

Fig. 1 3 is a diagram showing arrangement of parallax images on a display element using a color filter with a mosaic 
arrangement when an inclination of a single exit pupil in an optical plate is set to arctan (1/5) in one embodiment 
of the invention; 

Fig. 14 is a diagram showing arrangement of a plurality of elemental images on a display element using a color 
filter with a mosaic arrangement when an inclination of a single emit pupil in an optical plate is set to arctan (1/5) 
in one embodiment of the invention; 

Fig. 15 is a diagram showing parallax image numbers viewed via an optical plate with no inclination; 

Fig. 1 6 is a diagram showing parallax image numbers viewed via a single exit pupil in an optical plate whose 

inclination angle is arctan (1/6); 

Fig. 17 is a diagram showing parallax image numbers viewed via a single exit pupil in an optical plate whose 
inclination angle is arctan (1/4); 

Fig. 18 is a diagram showing parallax image numbers viewed via a single exit pupil in an optical plate whose 
inclination angle is arctan (1/5); 

Fig. 1 9 is a diagram showing a constitution of a three-dimensional image display device according to a f irst example 
of the invention; 

Fig. 20 is a diagram showing one example of a shape of an elemental image positioned at a screen end; 

Fig. 21 is a diagram showing occurrence of an elemental image constituted of a standard number of parallaxes; 

Fig. 22 is a diagram showing occurrence of an elemental image constituted of a standard number of parallax and 

one parallax generated for maximizing a viewing region in a three-dimensional image display device; 

Fig. 23 is a diagram showing an aspect of a distribution of an elemental image constituted of a standard number 

of parallaxes and an elemental image constituted of a standard number of parallaxes and one parallax; 

Fig. 24 is a diagram showing an ordinary constitution of a three-dimensional image display device; and 

Fig. 25 is a table showing a relationship among the number of parallaxes N, a ratio "a" where a vertical resolution 

is distributed to a horizontal resolution, and a size of an elemental image when a ratio of lowering in resolution in 

a horizontal direction is caused to coincide with that in a vertical direction. 
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DESCRIPTION OF THE EMBODIMENTS 

[0032] Embodiment of the present invention will be explained below with reference to the drawings. In respective 
figures, constituent elements having similar or identical functions are denoted with same reference numerals and further 

5 explanation thereof will be omitted. 

[0033] A three-dimensional image display device according to one embodiment of the present invention will be ex- 
plained with reference to the drawings. First of all, an ordinary constitution of a three-dimensional image display device 
is shown in Fig. 24. The three-dimensional image display device shown in Fig. 24 is provided with a two-dimensional 
image display device 14 constituted of : for example, a liquid crystal panel, and an optical plate 6. 

io [0034] The two-dimensional image display device 1 4 must have a constitution that pixels positioned within a display 
plane are flatly arranged in a matrix manner, but it may be a liquid crystal display device of a direct viewing type or a 
projection type, a plasma display device, a display device of electric field emission type, an organic EL display device, 
or the like. As the optical plate 6, a plate with slits or lenticular lenses extending in a generally vertical direction and 
arranged in a cyclic manner in a generally horizontal direction is used. In this case, there are parallaxes only in a 

15 horizontal direction 41 and an image varies according to a viewing distance, but since there is not an parallax in a 
vertical direction 42, a fixed image can be viewed irrespective of a viewing position. In Fig. 24, reference numeral 43 
denotes a position of a single eye of a viewer. 

[0035] In the three-dimensional image display device according to the embodiment, a display plane on the two- 
dimensional image display device includes sub-pixels of R (red), G (green), and B (blue) arranged in an array manner. 

20 The sub-pixels of R (red), G (green), and B (blue) can be realized by arranging a color filter on the display plane 
properly. In the embodiment, as shown in Fig. 2, the optical plate 6 is constituted of, for example, lenticular lenses 7. 
A longitudinal axis of each lenticular lens 7 is inclined to a sub-pixel column by a predetermined angle © 0). In Fig. 
2, reference numeral 4 denotes an opening portion of a sub-pixel and reference numeral 5 denotes a black matrix. In 
this embodiment, the sub-pixel includes the opening 4 and the black matrix 5. Accordingly, the sub-pixels are arranged 

25 so as to be adjacent to one another vertically and horizontally. Each sub-pixel has an aspect ratio (a ratio of a vertical 
size to a horizontal size) of 3:1 . 

[0036] In the embodiment, the reason why the longitudinal axis of the lenticular lens 7 is inclined to the sub-pixel 
column by the predetermined angle 9 (* 0) will be explained below. 

[0037] Three sub-pixels of R, G, and B arranged vertically are handled as one pixel in order to increase a horizontal 
30 resolution, and when the optical plate 6 is inclined, a horizontal resolution H and a vertical resolution V in a three- 
dimensional image to be displayed are expressed by the following equations (1). 

H = Horigina! x 3 N + a 
35 V = Voriginal - 3 x a (1) 

Here, Horiginal represents a horizontal resolution of a two-dimensional image display device, Voriginal represents a 
vertical resolution of the two-dimensional image display device, N represents the number of parallaxes, and "a" rep- 
40 resents a ratio of the vertical resolution which is distributed to the horizontal resolution by inclining the optical plate. 
[0038] Therefore, when the ratio of the vertical resolution Voriginal to the horizontal resolution Horiginal in the two- 
dimensional image display device is maintained even in the three-dimensional image display device, a relationship of 
the following equation (2) must be satisfied. 

45 Horignal : Voriginal = (Horigina! x 3 + N a) : (Voriginal 

+ 3 x a) 
That is, 3/(N»a) = a/3 

50 

Therefore, N = (3/a) 2 (2) 

[0039] Next, a phenomenon where the vertical resolution is distributed to the horizontal resolution by inclining the 
55 optical plate will be explained. Fig. 1 is a diagram showing various inclinations of an optical plate to pixels in a two- 
dimensional image display device. In Fig. 1 , reference numeral 3 denotes a region which is observed with a single eye 
via one of exit pupils continuous in a generally vertical direction of the optical plate 7 whose focus point is caused to 
coincide on the two-dimensional image display device. The region indicated by the reference numeral 3 shifts in a 
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horizontal direction according to movement of the viewing position. When the exit pupils in the optical plate 7 are formed 
so as to be continuous vertically in the same manner as the above pixels like the conventional art, pixels (whose centers 
are coincident with the regions indicated by reference numeral 3) whose centers are viewed via one of the exit pupils 
in the optical plate 7 are all pixels included in one column or zero, and a cycle where two states are switched from one 
to the other by movement of the regions indicated by the reference numeral 3 according to movement of a viewer 
coincides with a horizontal width of a sub-pixel. On the other hand, by inclining the optical plate 7, he number of pixels 
whose centers can coincide with the regions indicated by the reference numeral 3 is decreased and a cycle where 
pixels whose centers coincident with the regions appear when the regions indicated by the reference numeral 3 moves 
according to movement of a viewer becomes shorter than the width of the sub-pixel. Further, the centers of pixels are 
selected and simultaneously a non-display portion between sub-pixels adjacent to each other in a horizontal direction 
is present necessarily in the regions indicated by reference numeral 3. In Fig. 1, an example where vertical four rows, 
vertical five rows, and vertical six rows are respectively inclined to horizontal three columns is shown. The positional 
relationship between the regions indicated by the reference n umeral 3 and the pixels is repeated for every three columns 
for the vertical four rows, for every four rows for the vertical five rows, and for every one for the vertical six rows. That 
is, the number of pixels (having the same portion observed via one of exit pupils continuous in a generally vertical 
direction) having the same relative position to the regions indicated by reference numeral 3 is reduced to 1/4, 1/5 : and 
1/2. On the other hand, regarding the horizontal direction, pixels whose centers coincide with the regions indicated by 
the reference numeral 3 appear at a cycle of a 1/4 sub-pixel width, a 1/5 sub-pixel width, and a 1/2 sub-pixel width, as 
compared with the case that the optical plate is arranged vertically to the pixels. That is, the horizontal resolution is 
increased to four times, five times, and two times. An advantage obtained by distributing such a resolution to the 
horizontal resolution and means for preventing the display blocking caused due to the non-display portion have been 
described in detail in US Patent 6,064,424. 

[0040] As described above, though the vertical resolution can be distributed to the horizontal resolution by inclining 
the optical plate, when parallax images are distributed at a sub-pixel pitch, the degree of the distribution is affected by 
a shape of the sub-pixel 2. For example, when a liquid crystal display device used as a two-dimensional image display 
device employs such a design that a square pixel is constituted of three sub-pixels of RGB and such a design that 
many vertical straight lines such as characters are displayed, since a color fjlter with a vertical stripe arrangement is 
often used, the shape of the sub-pixel has a ratio of vertical: horizontal = 3: 1 , such as shown in Fig. 1 . Consideration 
is made about a case that one pixel is handled with three sub-pixels 2 dispersed in different three columns, instead of 
three sub-pixels adjacent to one another in a horizontal direction, in order to increase the horizontal resolution in the 
three-dimensional image display device. When the inclination G of a ridge line of an optical plate is expressed as the 
following equation 3, a cycle where pixels whose centers coincide with the regions indicated by the reference numeral 
3 appear becomes 1/n of the sub-pixel width so that the horizontal resolution per sub-pixel unit becomes n times. 

G = arctan (1/n) (3) 

[0041] Simultaneously, since one pixel (a triplet) is constituted of three sub-pixels (which do not coincide with one 
another in the vertical direction) of RGB whose centers are coincident with regions indicated by reference numeral 3 
at the 1/n cycle and which are adjacent to one another in the horizontal direction, the ratio "a" where the vertical 
resolution is distributed to the horizontal resolution is represented as the following equation 4. 

a = 3/n (4) 

[0042] That is, in the triplet at a time of three-dimensional image display in the present invention, observation allow- 
able positions for three sub-pixels of RGB slightly deviate from one another (the regions indicated by the reference 
numeral 3 and the centers of three sub-pixels of RGB do not coincide with each other simultaneously). Therefore, such 
a coincidence is expressed below as "substantial coincidence" in this text. Since a portions of pixels can be actually 
viewed via exit pupils in a state where the regions indicated by the reference numeral 3 do not coincide with the centers 
of pixels, a region where sub-pixels of RGB with the substantial coincidence can be viewed simultaneously is present. 
In the case shown in Fig. 1, therefore, G = arctan (1/4), arctan (1/5), and arctan (1/6) are obtained, the ratio "a u where 
the vertical resolution is distributed to the horizontal resolution becomes 3/4, 3/5, and 1/2. 

[0043] Accordingly, the lowering percentages of the resolutions of the horizontal direction and the vertical direction 
are caused to coincide with each other by inclining the optical plate according to the equation (3) and simultaneously 
setting the relationship between n and N so as to meet the above-described equation (2). That is, design may be made 
so as to meet the following relationship between n and N. 
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N = n 2 (5) 

[0044] The number of parallaxes N, a ratio n a" where the vertical resolution is distributed to the horizontal resolution, 
5 the inclination angle 0 of the lens, and the elemental image size to respective natural numbers n are shown in Fig. 25. 
As understood from Fig. 25, in case of N = 9 (n = 3), an advantage obtained by distributing the vertical resolution to 
the horizontal resolution and an advantage of preventing display blocking due to a non-display portion can not be 
obtained due to the shape of the sub-pixel 2. 

[0045] An example where the number N of parallaxes is set so as to meet the relationship of the equation (5) will be 
10 explained with a QUXGA panel (a panel having a horizontal resolution H of 3200 and a vertical resolution V of 2400). 

(3200 >: 3 - 16 - a): (2400 + 3 X a) = 800: 600 

15 That is, a = 3/4 -> SVGA 

(3200 X 3 25 + a): (2400 + 3 X a) = 640: 480 

20 That is, a = 3/5 -> VGA 

[0046] That is, by controlling the number of parallaxes and the inclination according to the equations (2) to (4), the 
resolution of a three-dimensional image to be displayed could be caused to coincide with an ordinary resolution in the 
conventional two-dimensional image display. 

[0047] Differences between the embodiment and the art disclosed in US Patent 6,064,424 will be explained below 
25 in detail. 

[0048] First of all, in the art disclosed in US Patent 6,064,424, distribution of such a small number of parallaxes as 
3, 5, 6, or 7 is made according to such an inclination as 0 = arctan (1/n), (n = 6, 9, 12) in a SVGA panel (resolution: 
800 (H) x 600 (V)) (refer to Fig. 3). Therefore, when calculation is made using the calculation method (the equations 
(1) to (4) of the embodiment, the horizontal resolution becomes very high. For example, in an example where 6 par- 
30 allaxes are distributed according to 6 arctan (1/6) (refer to Fig. 2), n = 6 is obtained according to the equation (4) and 
a = 1/2 is obtained according to the equation (3). That is, since the ratio "a" where the vertical resolution is distributed 
to the horizontal resolution by the inclination is 1/2, 
a = 1/2 is obtained. 

[0049] That is, (800 x3-6-a): (600^-3 x a)= 800: 100 is obtained, which results in very high horizontal.resolution. 
35 Similarly, when 5 parallaxes are distributed according to 6 = arctan (1/6) and 7 paraltaxes are distributed to 6 = arctan 
(1/6), the followings are obtained, 
a =1/2 

[0050] That is, (800 x3+5*a): (600 + 3 x a) = 960: 1 00 
a =1/2 

40 [0051] That is, (800 X3+7 + a): (600 +3Xa) = 685: 100 

[0052] Incidentally, the resolutions in the art described in US Patent 6.064 : 424 are 480 x 200 and 342 x 200, or the 
ratios of the horizontal resolution to the vertical resolution are 480: 200 and 342: 200, which are different in value from 
the above calculations. As the reason, US Patent 6,064,424 describes the fact that such a design that each sub-pixel 
of RGB constitutes an almost square image in a state that they are viewed via the optical plate is adopted (refer to Fig. 

45 5). In Fig. 5, reference numeral 9 denotes a sub-pixel for a three-dimensional image display. In the art described in US 
Patent 6,064,424, there is a proposal that three sub-pixels of RGB of RGB sub-pixels constituting almost square pixels 
in a state the they are viewed via the optical plate which are positioned relatively near to one another are grouped to 
be handled as one pixel. Even if such handling is employed, the ratio of the horizontal resolution to the vertical resolution 
such as 480: 200 or 342: 200 is a resolution balance unique in the art disclosed in US Patent 6,064,424, where a three- 

50 dimensional image is not constituted of square pixels of a RGB triplet which has an ordinary pixel shape. 

[0053] The three-dimensional image display device according to the embodiment is quite different in the above point 
from the art disclosed in US Patent 6,064,424. This embodiment is constituted such that a triplet of RGB is viewed as 
a square pixel. That is, a design is employed that the relationship between the inclination and the number of parallaxes 
is defined according to the equations (2) to (4) and RGB triplets of constituent pixels constituting an image viewed via 

55 the optical plate become an almost square (refer to Fig. 4). In Fig. 4, reference numeral 8 denotes a pixel in the three- 
dimensional image display. 

[0054] Regarding a pixel mapping for realizing the above design, a case of N = 16 in the above-described QUXGA 
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panel will be explained with reference to Figs. 6A and 6B. Fig. 6A is a diagram showing arrangement of parallax images 
to a two-dimensional image display device with colorf ilters arranged in a stripe manner when an inclination of a lenticular 
sheet 7 is set to arctan (1/4), and Fig. 6B is a diagram showing relative positions of a plurality of elemental images. In 
Figs. 6A and 6B, reference numeral 10 denotes a parallax number, and reference numeral 11 denotes a diagram 

5 showing a range where an exit pupil corresponding to a single pixel which is a constituent unit for a three-dimensional 
image and an elemental image corresponding thereto are displayed. The number of parallaxes (N = 16) and the incli- 
nation angle (6 = arctan (1/4)) of an optical plate are determined according to the equations (2) to (4). As a result, the 
pixel for a three-dimensional image display is defined as a parallelogram (an almost square) constituted of 4 rows x 
4 pixel (triplet) columns (= a 12 sub-pixel row). RGB sub-pixels are mapped over different rows so as to meet an 

10 adoption ratio of 3/4 (= a) in the parallelogram. That is, a pixel for a three-dimensional image display constituted of 3 
rows (= RGB) x (5 + 1/3) pixel (triplet) columns (= 16 sub-pixel row) = 48 sub-pixels when the optical plate was not 
inclined could be formed in an almost square while maintaining the summed number of sub-pixels. 
[0055] Next, an advantage obtained by making the pixel for a three-dimensional image display almost square will 
be explained. When an advantage obtained by inclining the optical plate is not utilized, the horizontal resolution/vertical 

15 resolution is designed as follows: 

[0056] Since an outer shape of a QUXGA panel of H (3200 X 3 + 16) X V (2400 + 3) = H (600) x V (800) has 
horizontal: vertical = 4: 3, when the horizontal resolution/the vertical resolution (the number of pixels) meets 4: 3, 
sampling intervals in a horizontal direction and in a vertical direction are the same, so that a pixel shape at a display 
time of a three-dimensional image becomes square. Here, specifically, the pixel for a three-dimensional image display 

20 indicates a region on which an elemental image which is a collection of parallax images constituted of parallax images 
acquired (shot/prepared) from a plurality of directions. In the number of pixels for a three-dimensional image such as 
the conventional H (600) x V (800), since sampling intervals in the horizontal direction and in the vertical direction are 
different from each other (a pixel shape at a display time of a three-dimensional image is not square), the elemental 
image is composed by preparing parallax images with a resolution of, for example, H (3200 x 3) x V (2400) and 

25 removing unnecessary pixel information elements from these parallax images to change these parallax images to 
parallax images with a low resolution of H (600) x V (800). 

[0057] In the embodiment, such a constitution is employed focusing attention on the above waste that parallax images 
can be acquired with a resolution for a pixel for a three-dimensional image display by reflecting a ratio of a horizontal 
number of pixels to a vertical number of pixels in screen size and make sampling intervals in the horizontal direction 

30 and in the vertical direction equal to each other to make a pixel shape at a display time of a three-dimensional image 
almost square. That is, in a three-dimensional image display device using the QUXGA panel, parallax images for SVGA 
panel are acquired in case of 1 6 parallaxes or parallax images for VGA panel are acquire in case of 25 parallaxes, and 
an elemental image can be prepared by mapping the parallax images. In this case, parallax image information elements 
do not include pixel information which is not used (or removed). By forming a pixel for a three-dimensional image 

35 display in a square, speed-up in 3D - CG (three-dimensional image computer graphic) contents production can be 
achieved and lowering in resolution required for actual shooting can be made possible. 

[0058] Further, a secondary advantage obtained by causing the resolution of the three-dimensional image display 
to the conventional one to coincide with each other includes such a fact that handling when two-dimensional image 
contents is displayed in the three-dimensional image display device is made easy. It is assumed easily that two-dimen- 

40 sional image contents are displayed even in the three-dimensional image display device. Display of the two-dimensional 
image contents in the three-dimensional image display can be achieved simply by setting equal parallax information 
pieces within the elemental image (the same image can be always viewed regardless of a viewing position). That is, 
in the three-dimensional image display device using the QUXGA panel, when 2D (two-dimensional image) contents 
for SVGA to 1 6 parallaxes or for VGA to 25 parallaxes are inputted, a two-dimensional image can be displayed as.it 

45 js by simply increasing the two-dimensional image information pieces by 1 6 times or 25 times to develop them within 
the pixel for a three-dimensional image display. 

[0059] In addition, even when two-dimensional image contents with a resolution other than the above resolution are 
inputted, since a general technique for performing conversion between resolutions for a two-dimensional image itself 
has been already generalized, if the three-dimensional image display device itself has been set to an existing resolution, 

50 the two-dimensional image contents may be developed after the resolution thereof is corrected to the existing resolution. 
Even if such a design is employed that the resolution of the three-dimensional image is not an existing resolution but 
it is x times thereof or 1/y times thereof (x and y: integers), since such a design can be accommodated by simply 
developing data pieces for a conventional or existing resolution to x times, or simply compressing or thinning them to 
1/y times. Therefore, designing the resolution for the three-dimensional image display to a resolution of an integral 

55 multiple of the conventional or existing resolution or a resolution of 1 /integer thereof is effective for reducing load for 
image processing. 

[0060] Assuming that three-dimensional image display devices of various types are present, there is a high possibility 
that the resolution of the conventional or existing two-dimensional image is utilized as a format. Considering such a 
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future development, designing a display resolution in the three-dimensional image display device to the resolution in 
the exiting two-dimensional image display, or the resolution of the integral multiple of the resolution in the existing two- 
dimensional image display or the resolution of 1/integer thereof has important significance. 

[0061] Figs. 7 A and 7B are image views of screens viewed by making a pixel for a three-dimensional image display 
5 square. Fig. 7A is a view showing a portion of arrangement of elemental images on a two-dimensional image display 

device with a color filter arranged in a stripe manner when the inclination of the lenticular sheet 7 is set to arctan (1/4), 

and Fig. 7B is a view showing an appearance of a portion of a lenticular sheet 7 combined with the elemental images. 

The elemental image 1 1 is formed in an almost square shape and it is combined with the lenticular sheet 7 so that one 

pixel for a three-dimensional image display is constituted. Information about 16 parallaxes is included in one pixel for 
10 a three-dimensional image display by the picture-mapping in Figs. 6A and 6B, and the parallax image number viewed 

through the lenticular sheet is changed from one to another according to movement of a viewing position so that a 

stereoscopic view is realized. 

[0062] Next, a method for arranging parallax images acquired from a plurality of directions will be explained with 
reference to Fig. 8. Fig. 8 is a diagram showing distribution, to respective pixels on a three-dimensional image display 

is device, of image information pieces constituting parallax images acquired from a plurality of directions with a low res- 
olution by parallel projection corresponding to a horizontal direction and by perspective projection corresponding to a 
vertical direction in a state that an inclination of the optical plate 6 is set to arctan (1/4). In Fig. 8 ; reference numeral 8 
denotes a pixel for a three-dimensional image display observed through a lenticular sheet, reference numeral 12 de- 
notes a parallax image acquired with a resolution of 800 (H) x 600 (V) from a certain direction, and reference numeral 

20 13 denotes a pixel (triplet) constituted of three sub-pixels of RGB constituting a two-dimensional image which is a 
parallax image. The RGB triplet 1 3 constituting the parallax images 1 2 acquired from a plurality of directions is mapped 
as one parallax image for an elemental image constituting each pixel 8 for a three-dimensional image display shown 
in Fig. 8. A correspondence relationship between the RGB triplets 13 and the pixels 8 for a three-dimensional image 
display is shown with arrows in Fig. 8. Since one pixel in the three-dimensional image display forms a parallelogram, 

25 correspondence to parallax image information can be obtained by shifting a pixel for a three-dimensional image display 
to the left by one pixel for every four columns of the pixel 8 for a three-dimensional image display. The shift corresponds 
to one pixel shifting in a three-dimensional image display resolution of 800 x 400. Therefore, when the three-dimen- 
sional image display becomes sufficiently high, the shift can be suppressed to such an extent that a viewer is not 
nervous about the shift. 

30 [0063] The information about a single parallax image has been explained here, but an elemental image corresponding 
to all pixels for a three-dimensional image display can be prepared by distributing parallax images with a resolution of 
800 (H) x 600 (V) acquired from a plurality of directions (here, 16 directions) according to Fig. 8 -> Figs. 6A and 6B. 
[0064] Figs. 6A and 6B show the example where the pixel mapping has been performed on the assumption that a 
color filter with a stripe arrangement is used, but mapping may be performed regarding another color filter arrangement. 

35 Arrangement of parallax images on a two-dimensional image display device where the color filter arrangement is a 
mosaic arrangement is shown in Fig. 9, and arrangement of a plurality of elemental images are shown in Fig. 10. The 
color filter arrangement is finally determined to be optimal based upon color moire generated due to correlation between 
the standard number of parallaxes and the color filter or another displaying performance. For example, in the consti- 
tution of the present invention, since a horizontal pitch of exit pupils becomes multiples of 3 to a sub-pixel width, when 

40 a device using the color filter with a stripe arrangement is used as the two-dimensional image display device, equal 
colors are arranged in a horizontal direction (color moire of one kind). Therefore, when the resolution in the three- 
dimensional image display device is not high sufficiently such a case that a viewer is nervous about the horizontal 
RGB stripe may occur. In this case, such a problem can be solved by adopting a mosaic arrangement. Even when a 
color filter arrangement other than the stripe arrangement or the mosaic arrangement is employed, it is necessary to 

45 perform mapping correspondingly. In either case, such a design can be adopted that a triplet of RGB is mapped on 
different columns and the triplet can be substantially simultaneously viewed through a lens. 

[0065] Further, arrangement of parallax images on a two-dimensional image display device using a color filter with 
a stripe arrangement when the standard number of parallaxes (N) is 25, namely, when the inclination of the optical 
plate is set to arctan (1/5) is shown in Fig. 11 A, relative positions among a plurality elemental images are shown in Fig. 

50 11B, and arrangement of a plurality of elemental images is shown Fig. 12. Arrangement of parallax images on a two- 
dimensional image display device using a color filter with a mosaic arrangement when the inclination of the optical 
plate is set to arctan (1/5) is shown in Fig. 13, and arrangement of a plurality of elemental images is shown in Fig. 14. 
[0066] Now, as also described in US Patent 6,064,424, when the inclination of the optical plate becomes small, there 
is a problem that crosstalk between parallax images increases. This becomes especially significant when such a small 

55 angle as shown in US Patent 6,064,424 (G = arctan (1/n), n = 6, 9, 12; refer to Fig. 3). 

[0067] The amount of crosstalk will be explained with reference to Fig. 15 to Fig. 18. Fig. 15 is a diagram showing 
parallax numbers viewed through an optical plate which has an inclination of zero, namely, whose exit pupils are vertical. 
In Fig. 15, reference numeral 15 shows a ratio of the parallax numbers viewed through the exit pupils. For example, a 
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focal position of an exit pupil of a single lens of a plurality of semi-cylindrical (a shape obtained by cutting a cylinder in 
a longitudinal axis and adhering the cut cylinder and a cube having a side face with the same size as that of the cut 
face to each other) constituting a lenticular sheet arranged on a front face of an image display device formed in a matrix 
shape is shown with a dotted line. In this case, a width of a sub-pixel for a two-dimensional image display in an image 

5 display device is set to 1/3 of a height of the sub-pixel, so that a square triplet is formed of three sub-pixels. A reference 
numeral 1 0 is a parallax image number described in each sub-pixel. The lenticular sheet is designed such that a two- 
dimensional image display device where pixels are provided in a matrix shape is positioned at a position of a focal 
length thereof, so that a width of a broken line (a focal position) on the two-dimensional image display device can be 
assumed to be infinitely small. As shown in Fig. 15, when a lenticular lens is vertical (the inclination is zero), only a 

10 parallax image with a single number is viewed from a single exit pupil. Alternatively, when a region indicated by a 
reference numeral 3 coincident with a vertical pixel boundary between sub-pixels adjacent to each other in a horizontal 
direction, any parallax image is not viewed at all. 

[0068] On the other hand, Fig. 16 is an explanatory diagram showing parallax numbers viewed through exit pupils 
in an optical plate when the inclination of the lenticular lens is 6 = arctan (1/6). In this case, parallax images over at 
15 least two parallaxes and at most three parallaxes can be viewed via a single exit pupil simultaneously. Hereinafter, a 
parallax image to be viewed actually is called "a main parallax", and another parallax image which has been viewed 
simultaneously with the main parallax is called "an adjacent parallax". 

[0069] As experimental results supporting a difference in vision between parallax images, the followings are shown. 
In the IP type three-dimensional image display device using the arrangement shown in Fig. 15, contents with an ex- 

20 cessive projection amount/an excessive depth amount appears as a double image. On the other hand, in the arrange- 
ment shown in Fig. 16, the parallax image is viewed as blur and a width of the blur is larger than a deviating width of 
the double image in Fig. 15. This phenomenon occurs due to that a difference between parallax images is large in 
contents with a large projection amount/a large depth amount so that a crosstalk generated by viewing a main parallax 
and an adjacent parallax simultaneously can be recognized easily. In the constitution shown in Fig. 15, only a single 

25 parallax number should be originally viewed. In an actual machine which has been manufactured by the present in- 
ventors, however, a lens is slightly defocused, where when a region indicated by reference numeral 3 coincides with 
a boundary, parallax images on both side of the boundary can be viewed. That is,. there is a case that an adjacent 
parallax image together with a main parallax image is viewed. A double image was viewed due to the adjacent image 
viewed simultaneously with the main parallax image. 

30 [0070] On the other hand, in the constitution shown in Fig. 16, a region indicated by reference numeral 3 crosses 
pixels obliquely, which means that the main parallax image and the adjacent parallax image can be seen via a single 
exit pupil while being smoothly switched between them. Simultaneously therewith, the number of adjacent parallax 
images viewed via a single exit pupil exceeds the number thereof in the constitution shown in Fig. 15. That is, influence 
due to the adjacent parallax image appears as a blur different from a double image shown in Fig. 15. Further, it can 

35 be understood that a range of the blur becomes broader than the case shown in Fig. 15 due to a high number of 
adjacent parallax images to be viewed. 

[0071 ] The lenticular lens is set obliquely in this manner so that the amount of crosstalk is increased and the crosstalk 
is viewed as a blur. The occurrence of crosstalk eventually restricts a projection display region/a depth display region 
of contents. Therefore, an example of n = 6 meaning a relatively small inclination, namely, an example of a selection 

40 ratio of 1/2 is positively described in US Patent 6,064,424. 

[0072] Fig. 17 and Fig. 18 are diagrams showing parallax numbers viewed through optical plates set to G = arctan 
(1/4) and 0 = arctan (1/5) in this embodiment. As shown in Fig. 17, it is understood that, in the case of G = arctan (1/4), 
parallax images appearing as crosstalk correspond to three parallaxes, which is the same as the case of G = arctan 
(1/6), but an occupation ratio of a main parallax image to a plurality of parallax images which can be viewed simulta- 

45 neously is high. As shown in Fig. 18, it is understood that, in the case of e = arctan (1/5), parallax images appearing 
as crosstalk correspond to three parallaxes, but an occupation ratio of a main parallax image to parallax images is 1/2 
or more. That is, in these inclinations, i.e., in the cases of G = arctan (1/4) and G = arctan (1/5), crosstalk occurs, but a 
ratio of mixing of adjacent parallax images other than a main parallax image is low so that such an advantage can be 
obtained that blur is reduced and a projection /depth display region is broadened. 

50 [0073] As described above, the present invention includes a novel definition achieving such plural new advantages 
that 9 * arctan (1/3m) including these inclinations (G = arctan (1/4) and G = arctan (1/5)) serves not only to prevent 
display blocking due to the non-display region in the conventional technique but also to maintain a ratio of a horizontal 
resolution/a vertical resolution and to form a pixel shape at a display time of a three-dimensional image in an almost 
square, and it serves to facilitate conversion of contents and further expand a display-allowable range in a depth/ 

55 projection direction by avoiding waste at a time of elemental image preparation and considering an existing resolution 
in a two-dimensional image display. Further, in the concept disclosed in US Patent 6,064,424, an approach where the 
horizontal resolution is cut at a pitch of 1/2 to 1/4 time a sub-pixel width (the horizontal resolution is increased to 2 to 
4 times and the vertical resolution is decreased to 1/2 to 1/4 time) is employed. On the other hand, in the embodiment, 
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such an approach that the horizontal resolution is cut at a pitch which is not 1/m time such as 3/4 time or 3/5 times by 
selecting three sub-pixels which are positioned in different rows to the same parallax image is employed, which is a 
novel approach. Moreover, since 2 values of, especially, a = 3/4 and a = 3/5 which are included in a group of a * 1/3m 
is a value of 1/2 or more, a mixing ratio of an adjacent parallax image becomes low and a clear parallax image where 

5 crosstalk is further suppressed can be viewed. 

[0074] Such a fact that it is effective to incline a lens for solving a problem about moire has been already described 
in detail. In further description, it is effective for suppressing moire that a Cs line {supplemental capacitance) in a LCD 
(liquid crystal display) panel is set to pass across a center portion of a sub-pixel from side to side. This is because an 
opening center portion is made double by dividing the sub-pixel into upper and lower halves by the Cs line {the sup- 

10 plemental capacitance line), an occurrence cycle of an opening center viewed through an exit pupil in an optical plate 
is made short according to application of the above-mentioned content, so that a distribution of luminance reduction 
generated due to a non-display potion of a pixel can be made even within a screen in the IP system and it can be made 
even in a space in the multiview system. 

[0075] Inthe IP system, it is necessary to distribute elemental images constituting (the standard number of parallaxes 
15 + 1 ) columns discretely in order.to secure a viewing area fully (for example, refer to Japanese Patent Application No. 
2002-282389 which has been assigned to assignee of this application). However, It is possible to combine a lenticular 
sheet with an inclination according to the embodiment and this approach for application to the IP system. 
[0076] In the above, mapping of parallax images has been recommended as shown in Fig. 8 in order to achieve high 
efficiency for acquiring parallax image information at a time of elemental image preparation. However; a two-dimen- 
20 sional image where pixel arrangement at a display time of a three-dimensional image is maintained may be acquired 
in order to avoid image degradation due to shifting corresponding to one pixel width of a pixel for a three-dimensional 
image display in a horizontal direction for every four rows in Fig. 8. That is, the above image degradation can be 
completely prevented by using parallax images which have a resolution of 800 (H) x 600 (V) and are arranged in a 
matrix manner of parallelogram with an inclination of 0 = arctan (1/4) equivalent to the case shown in Fig. 8 instead of 
25 using parallax images whose pixel centers constitute a square matrix. This can be realized easily by causing pixel 
arrangement in a camera used for obtaining a shot image or pixel arrangement in a camera assuming image acquire- 
ment in a 3D - CG case to correspond to pixel arrangement for a three-dimensional image display at a display time of 
a three-dimensional image shown in Fig. 8. 

[0077] A method can be applicable of re-preparing image data for a parallelogram matrix arrangement from two- 
30 dimensional image information for a square arrangement. When two-dimensional image information acquired as data 
on a square grating in a plurality of directions is combined into an image for a three-dimensional image display whose 
center coordinates are positioned on a parallelogram grating for a three-dimensional image display, as described pre- 
viously, assuming that a method which selects a nearest neighbor pixel to take a real number value instead of an 
integer value is a nearest neighbor method called in an image interpolation process, it is considered to apply a bi-linear 
35 process which performs a linear density interpolation according to coordinates (a real number value) of a parallelogram 
grating from two pixels of data on a square grating adjacent to each other horizontally {because of the parallelogram 
grating). Similarly, a bi-cubic method may be applicable. In this application, however, a technique corresponding to the 
nearest neighbor method is proposed considering such a merit that it is unnecessary to re-configure image data. A 
data preparation for a three-dimensional image display like the bi-linear method or the bi-cubic method may be selected 
40 according to balance between load for re-configuration of image data and image quality. 

EXAMPLES 

[0078] Examples of the present invention will be explained below. 

45 

(Example 1) 

[0079] In Example 1 , a multiview type three-dimensional image display device with a structure shown in Fig. 1 9 was 
manufactured. The two-dimensional image display device 14 was a liquid crystal display device, which was provided 

50 at a front face thereof with an optical plate 6 and at a rear face thereof with a back light 1 6. 

[0080] Specifically, in the example 1 , a QUXGA - LCD panel (the number of pixels of 3200 x 2400 and a screen size 
of 480mm x 360mm) was used as the liquid crystal display device. In the liquid crystal display device 14, three pixels 
of red color, green color, and blue color can be driven independently. A length of each of the pixels of red, green, and 
blue in a horizontal or lateral direction was 50 jim and a length thereof in a vertical direction was 150^.m. The color 

55 filter arrangement was a stripe arrangement. Incidentally, in an ordinary two-dimensional image display device, one 
pixel (one triplet) is constituted of three sub-pixels of red, green, and blue colors arranged laterally or horizontally. In 
this example, such a constraint was released. 

[0081 ] A lenticular sheet including lenticular lenses designed such that a pixel position in a liquid crystal display panel 
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corresponded to almost a focal length was used as the optical plate 6. Such a design was employed that a horizontal 
lens pitch was made slightly narrower than 600u,m which was two times a sub-pixel width and light rays was converged 
at 16 portions at a viewing distance of 1 .Om with 1/2 pitch (= 32.5mm) of an inter-eye distance, where a viewing zone 
at the viewing distance corresponded to the screen width. The lenticular lenses were arranged at an angle deviated 
from a vertical direction by about 14.0°. 

[0082] Next, the image producing method will be explained. 16 parallax images (resolution: 800 (x RGB) x 600) 
were acquired by a camera (a virtual camera in CG) from positions of respective converging points of light rays ac- 
cording to a perspective projection. All the image information (800 x RGB x 600 x 16 parallax information) acquired 
was mapped on a QUXGA panel according to mapping shown in Figs. 6A and 6B. Column information was maintained 
by performing shifting of one column to the left for every four rows for a pixel for a three-dimensional image display. 
As shown in Fig. 20, as regards an elemental image on the left end regarding the (4n + 1)-th row and the (4n + 2)-th 
row and parallax information about an elemental image on the right end regarding (4n + 3)-th row and 4n-th row, 
portions where their parallax information lacked (mapping could not be performed) occurred. For example, regarding 
the first to fifth parallax images, data corresponding to one column and one row for constituting an elemental image at 
the left end on (4n + 1)-th row was discarded. Regarding the sixth parallax image information, mapping of only one 
sub-pixel information corresponding to a color of a sub-pixel distributed with a parallax image number 6 In an elemental 
image was performed, and similarly mapping of only two sub-pixels information was performed regarding the seventh 
parallax image. Regarding the eighth parallax image information and parallax images information subsequent thereto, 
all pixel information was mapped. 

[0083] When observation was made with the above lens combination after mapping of image information was per- 
formed in the above manner, a stereoscopic image of a multiview system could be viewed at a viewing distance of 
1.0m or so (since light rays were converged at 1/2 of an inter-eye distance, a region where an image was viewed in a 
stereoscopic manner was also present before and after the viewing distance). In the multiview type three-dimensional 
image, balance in resolution between a vertical direction and a horizontal direction was improved and contents with a 
spatial frequency of about 300cpr could be displayed with a depth of the maximum about ± 5cm before and after the 
display plane by inclining the lens. Though screen luminance change due to the non-display portion occurred according 
to movement of a viewing position, occurrence of luminance unevenness within the screen (moire) was suppressed. 

(Example 2) 

30 

[0084] In Example 2, an IP type three-dimensional image display device with the structure shown in Fig. 19 was 
manufactured. By designing a pitch of an exit pupil of an optical plate to an integral multiple a sub-pixel pitch in the 
image display device, such a constitution was achieved that a converging point of light rays did not occur in a viewing 
distance, which was different from the multiview system. Differences between Example 2 and Example 1 will be ex- 
35 plained below. 

[0085] Design was made that a horizontal pitch of a lens was four times a sub-pixel width, Le„ 600ujti, and a viewing 
range was ±15°. Thereby, the viewing range (a region could be viewed without mixing a quasi image) corresponding 
to a screen width at a viewing distance of 1 .Orn could be secured. An inclination of a lens was about 14.0°. 28 parallax 
images whose horizontal directions were applied with parallel projection and whose vertical directions were applied 

40 with perspective projection were acquired at the viewing distance by setting a target point on a center of a screen and 
using a camera (a virtual camera in CG). Because a converging point of light rays were not provided at the viewing 
distance, in the IP system where perspective projection images obtained at the viewing distance could not be used, 
when the viewing region was intended to be maximized at the viewing distance, the number of parallax images acquired 
(the number of positions of a camera acquiring an image) became more than that obtained in the multiview system 

45 where a converging point of light rays was provided at the viewing distance. In the embodiment where light rays be- 
comes parallel between adjacent exit pupils, the number of parallel projection parallax images (camera images) ob- 
tained increases to the standard number of parallaxes (= 16). As to the details thereof, refer to Japanese Patent Ap- 
plication No. 2002-3B2389 which was assigned to the present assignee. Here, parallax images were acquired with a 
resolution of 800 (x RGB) x 600 from 28 directions. 800 x RGB x 600 x 28 parallax information was basically mapped 

so according to the mapping shown in Fig. 6. Incidentally, in the IP system where parallax is taken in consideration, design 
of elemental image width > exit pupil pitch can be made in a pseudo manner by interposing an elemental image with 
(the standard number of parallaxes + 1) parallaxes discretely such that image information from each elemental image 
can be viewed within the viewing region. Fig. 21 shows one example of the design. After mapping including parallax 
image numbers 1 to 16 shown in Fig. 21 is repeated plural times, mapping including parallax image numbers 1 to 17 

55 shown in Fig. 22 occurs. Thereafter, an elemental image which has the same area as that shown in Fig. 21 but includes 
parallax image numbers 2 to 17 is repeated, but a shape thereof is slightly different from that shown in Fig. 21 (refer 
to Fig. 23). 

[0086] When all 28 parallax images are acquired at the same resolution of 800 (H) x 600 (V) due to such a fact that 
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this system is an IP system, image information which is not used occurs substantially (As to the details thereof , refer 
to Japanese Patent Application No. 2002-382389 which was assigned to the present assignee). In addition thereto, 
there occurs a portion from which parallax information about elemental images at both ends of a screen is discarded 
like the first example (refer to Fig. 20). 

5 [0087] This IP system was slightly complicated as compared with the multiview system, but when observation was 
made with mapping of image information with a resolution of 800 x 600 and the combination of lenses described 
above, a stereoscopic image of an IP system could be viewed in a viewing region based on a viewing distance of 1m. 
The IP system three-dimensional image was improved in a vertical/horizontal resolution balance so that image quality 
was improved and depth display of at most ± 5cm before and after the display plane could be made possible. Any 

10 luminance unevenness (moire) within a screen due to a non-display portion was not viewed and luminance change 
depending on a viewing position could be suppressed completely. A smooth kinematic parallax which was a feature 
of the IP system where a converging point of light rays was not present at the viewing distance could be realized. 

(Example 3) 

75 

[0088] Example 3 was approximately similar to the example 2, but it adopted such a design that the standard number 
of parallaxes was increased to 25. A lenticular lenses designed such that a pixel position on a liquid crystal display 
panel was a focal length was used as the optical plate. A horizontal pitch of a lens was set to 750 u,m which was 15 
limes a sub-pixel width and an inclination of the lenticular sheet was set to about 11 .3°. 

20 [0089] At a viewing distance, 44 parallax images whose horizontal directions and vertical directions were applied 
with parallel projection were acquired at the viewing distance by setting a target point on a center of a screen and using 
a camera (a virtual camera in CG). A resolution of the parallax image had a resolution of 640 (x RGB) x 4B0. Mapping 
of 640 x RGB x 480 x 25 parallax information was basically performed according to the mapping shown in Fig. 8. As 
shown in Fig. 12, column information was maintained by shifting three-dimensional image display pixels to the left by 

25 a width of the three-dimensional image display pixel for every five rows thereof. Two elemental images at left ends of 
the (5n + 1)-th and the (5n + 2)-th rows, an elemental image at both ends of the (5n + 3)-th row, and two elemental 
images at right ends of the (4n + 4)-th and the 5n-th rows included portions where parallax information was lacking 
(mapping could not be performed). 

[0090] This IP system was slightly complicated as compared with the multiview system, but when observation was 
30 made with mapping of image information with a resolution of 640 x 480 and the above-described combination of 
lenses, a stereoscopic image of an IP system could be viewed in a viewing region based on a viewing distance of 
1 .0m. The IP system three-dimensional image was improved in a vertical/horizontal resolution balance so that image 
quality was improved and depth display of at most about ± 15cm before and after the display plane could be made 
possible. Any luminance unevenness (moire) within a screen due to a non-display portion was not viewed and lumi- 
35 nance change depending on a viewing position could be suppressed completely. A smooth kinematic parallax which 
was a feature of the IP system where a converging point of light rays was not present at the viewing distance could be 
realized. 

(Example 4) 

40 

[0091] Example 4 was approximately similar to Example 2, but it adopted a display panel having a color filter with a 
mosaic arrangement. Differences between Example 4 and Example 2 will be explained below. 

[0092] Regarding 28 parallax images acquired at a resolution of 800 (x RGB) x 600, 800 (x RGB) x 600 x 28 
parallax image was mapped according to the mapping shown in Fig. 9. In the IP system, elemental images of (the 
45 standard number of parallaxes + 1) parallaxes were generated discretely such that image information from each ele- 
mental image could be viewed within a viewing range. When observation was made with a combination thereof with 
a lens, a stereoscopic image of an IP system could be viewed within a viewing range based upon a viewing distance 
of 1m. 

[0093] The IP system three-dimensional image was improved in a vertical/horizontal resolution balance so that image 
so quality was improved and depth display of at most about ± 5cm before and after the display plane could be made 
possible. Any luminance unevenness (moire) within a screen due to a non-display portion was not viewed and lumi- 
nance change depending on a viewing position could be suppressed completely. A smooth kinematic parallax which 
was a feature of the IP system where a converging point of light rays was not present at the viewing distance could be 
realized. Further, since the color filter with the mosaic arrangement was employed, R, B or G viewed through the 
55 lenticular sheet were further dispersed, so that there was a tendency that display blocking due to continuation of regions 
which were viewed as R, B, or G could be suppressed. 
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Comparative Example 1 

[0094] In a three-dimensional image display device of a multiview system similar to Example 1 , an inclination of a 
lens was changed to 9.5° which was equivalent to the art disclosed in US Patent No. 6,064,424, a horizontal width of 
5 a lens was correspondingly set to 400um equal to 8 sub-pixels width which was 1/2 a width of 16 sub-pixels, and 
corresponding mapping was performed like that in the art disclosed in US Patent No. 6,064,424. In this design, a 
resolution in the three-dimensional image was follows: 
"a" = 1/2, 

therefore, (3200 x 3 - 16 - a): (2400 3 x a) = 1200: 400. 

10 [0095] That is, the horizontal resolution became higher than the vertical resolution. Accordingly, parallax images with 
a resolution of H (1200) x V (900) were acquired and horizontal information was acquired at a rate of 4/9 (it was 
discarded at a rate of 5/9), so that mapping of image information was performed. That is, a time for image production 
was required excessively corresponding to acquisition of waste parallax image information and a large memory capacity 
was required for temporarily storing respective parallax image data elements acquired from plural directions. A balance 

15 jn resolution of an image displayed was bad, which impressed poor vertical information relative to horizontal information. 
An amount of crosstalk was larger than that in Examples, and a depth display was suppressed to ± 3cm before and 
after the display plane. When contents with an existing resolution was displayed, it was necessary to modify the existing 
resolution to a resolution of H (1200) x V (400), which resulted in a device with a poor versatility. 

20 Comparative Example 2 

[0096] In a three-dimensional image display device of a multiview system similar to Example 2, an inclination of a 
lens was set to 18.4°. When the inclination was employed, an advantage obtained by distributing a vertical resolution 
to a horizontal resolution can not be obtained. Therefore, a horizontal width of a lens was set to 800ji.m equal to a width 
25 of 1 6 sub-pixels, and corresponding mapping (RGB sub-pixels continuous obliquely were grouped) was performed. In 
this design, a resolution in the three-dimensional image was as follows: 
"a" = 1 , 

therefore, (3200 x 3+ 16+a): (2400 + 3 x a) = 600: 800. 
[0097] That is, the vertical resolution became higher than the horizontal resolution. Accordingly, parallax images with 

30 a resolution of H (1600) x V (1200) were acquired, and only 3/8 of data in a horizontal direction and 2/3 of data in a 
vertical direction were acquired, while the remaining data was discarded, so that mapping of image information was 
performed. That is, a time for acquiring parallax image information was excessively required corresponding to data to 
be discarded. A balance in resolution of an image displayed was bad, which impressed poor horizontal information 
relative to vertical information. When contents with an existing resolution was displayed, it was necessary to modify 

35 the existing resolution to a resolution of H (600) x V (800), which resulted in a device with a poor versatility. 

[0098] Additional advantages and modifications will readily occur to those skilled in the art. Therefore, the invention 
in its broader aspects is not limited to the specific details and representative embodiments shown and described herein. 
Accordingly, various modifications may be made without departing from the scope of the invention as defined by the 
appended claims. 

40 

Claims 

1. A three-dimensional image display device comprising: 

45- 

a two-dimensional image display device where pixels constituting a pixel group displaying an elemental image 
are arranged in a matrix shape; and 

an optical plate which has exit pupils corresponding to the pixel group and controls light rays from the pixels 
of the pixel group, wherein 

50 the exit pupils in the optical plate are constituted so as to be continued in an approximately vertical direction, 

and an angle formed between a direction in which the exist pupils are continued and a column direction of a 
pixel arrangement in the two-dimensional image display device is given by arctan (1/n) when n is a natural 
number which is different from multiples of 3. 

55 2. A three-dimensional image display device according to claim 1 , wherein the standard number of parallaxes N is 
given by square n 2 of the natural number n. 

3. A three-dimensional image display device according to claim 1 or 2, wherein n is a natural number of 4 or more. 
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4. A three-dimensional image display device according to any one of claims 1 to 3, wherein n is 4 or 5. 

5. A three-dimensional image display device according to any one of claims 1 to 4 f wherein a ratio of a horizontal 
resolution to a vertical resolution in a three-dimensional image is coincident with a ratio of a horizontal resolution 

5 to a vertical resolution in the two-dimensional image display device. 

6. A three-dimensional image display device according to any one of claims 1 to 5, wherein a pixel region constituting 
the. elemental image is formed in an approximately square shape. 

w 7. A three-dimensional image display device according to claim 6, wherein a formation region of the elemental image 
is an approximately square region of n rows x n columns, and RGB sub-pixels having the same parallax number 
are positioned over three rows of the n rows forming the elemental image, which are different from one another. 

8. A three-dimensional image display device according to claim 6, wherein a formation region of the elemental image 
is is an approximately square region of n rows x n columns, and RGB sub-pixels having the same parallax number 

are positioned over three columns of the n columns forming the elemental image, which are different from one 
another. 

9. A three-dimensional image display device according to claim 7 or 8, wherein three sub-pixels of R, G, and B whose 
20 positions viewed through the exit pupils are close to one another of a plurality of sub-pixels forming a pixel region 

displaying the elemental image are grouped and attached with the same parallax number. 

10. A three-dimensional image display device according to any one of claims 1 to 4, wherein, when arrangements of 
RGB sub-pixels having the same parallax number belong to different elemental image, the arrangements are the 

25 same. 

1 1 . A three-dimensional image display device according to any one of claims 1 to 4 ? wherein, when m and I are positive 
integers, arrangement of RGB sub-pixels having parallax number m and arrangement of RGB sub-pixeis having 
parallax number (m + n x 1) are the same. 

30 

12. A three-dimensional image display device according to any one of claims 1 to 4, wherein, when a plurality of 
elemental images are viewed through a single column extending over the plurality of elemental images, the parallax 
number continuously increases upwardly from 1 to N and the increase is repeated. 

35 13. A three-dimensional image display device comprising: 

a two-dimensional image display device where pixels constituting a pixel group displaying an elemental image 
are arranged in a matrix shape; and 

an optical plate which has exit pupils corresponding to the pixel group and controls light rays from the pixels 

40 of the pixel group, wherein 

the exit pupils in the optical plate are constituted so as to be continued in an approximately vertical direction, 
and an angle formed between a direction in which the exist pupils are continued and a column direction of a 
pixel arrangement in the two-dimensional image display device is given by arctan (1/n) when n is a natural 
number which is different from 3, and the standard number N of parallaxes is given by square n 2 of the natural 

45 number n. 

14. A three-dimensional image display device according to claim 13, wherein n is a natural number of 4 or more. 

15. A three-dimensional image display device according to any one of claims 2 } 13, and 14, wherein the standard 
so number N of parallaxes is 16 or 25. 

16. A three-dimensional image display device comprising: 

a two-dimensional image display device where pixels constituting a pixel group displaying an elemental image 
55 are arranged in a matrix shape; and 

an optical plate which has exit pupils corresponding to the pixel group and controls light rays from the pixels 
of the pixel group, wherein 

the exit pupils in the optical plate are constituted so as to be continued in an approximately vertical direction, 
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and an angle formed between a direction in which the exist pupils are continued and a column direction of a 
pixel arrangement in the two-dimensional image display device is given by arctan (1/n) when n is a natural 
number of 4 or more. 

A three-dimensional image display device according to claim 16, wherein the standard number of parallaxes N is 
given by square n 2 of the natural number n. 

A three-dimensional image display device according to claim 17, wherein the standard number of parallaxes N is 
any one of 36, 49, 64, and 81 . 

A three-dimensional image display device according to claim 16, wherein n is any one of 6, 7, 8, and 9. 
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FIG. 6B 
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FIG. 22 



33 

BNSDOCID: <EP 1S66683A1 J_> 



EP 1 566 683 A1 




BNSDOCID: <EP 1 566683A1_I_> 



34 



EP 1 566 683 A1 




BNSDOCID: <EP 15666B3A1J_> 



35 



EP 1 566 683 A1 



N (NUMBER 
OF PARAL- 
LAXES) 


A (RATIO WHERE 
VERTICAL RESO- 
LUTION IS DISTRI- 
BUTED TO HORI- 
ZONTAL RESOLU- 
TION) 




6 (INCLINA- 
TION OF 
LENS)[° ] 


ELEMENTAL 
IMAGE SIZE 
(ROW x COL- 
UMN [PIXEL]) 


= n 2 


= 3/n 


1 /n 


= ARCTAN(1/n) 




1 


3 


1 


45.0 


1X1 


4 


3/2 


1/2 


26.6 


2x2 












16 


3/4 


1 /4 


14.0 


4X4 


25 


3/5 


1/5 


11.3 


5X5 


36 


1 12 


1/6 


9.5 


6x6 


49 


3/7 


1 17 


8.1 


7x7 


64 


3/8 


1/8 


7.1 


8x8 


81 


1 /3 


1 /9 




9X9 













FIG. 25 



1566683A1 I > 



36 



EP 1 566 683 A1 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 05 25 0759 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate, 
of relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION (tntCI.7) 



EP 0 791 847 B ( KONINKLI JKE PHILIPS 

ELECTRONICS M.V) 

22 January 2003 (2003-01-22) 

* paragraphs [0001] - [0927], [0029], 

[0032]; figures 1-3 * 



1-19 



602B27/22 
H04N13/00 



US 2002/011969 Al (LIPT0N LENNY ET AL) 
31 January 2002 (2002-01-31) 

* paragraph [0021] - paragraph [0026] ; 
figure 4 * 

BERKEL VAN C ET AL: "CHARACTERISATION AND 
OPTIMISATION OF 3D-LCD MODULE DESIGN" 
PROCEEDINGS OF THE SP1E, SPIE, BELLINGHAM, 
VA, US, 

vol. 3012, 11 February 1997 (1997-02-11), 
pages 179-186, XPOO900O176 . 
ISSN: 0277-786X 

* the whole document * 



1,13,16, 
19 



16 



W0 99/05559 A (KONINKLI JKE PHILIPS 

ELECTRONICS N.V; PHILIPS AB) 

4 February 1999 (1999-02-04) 

* page 6 - page 11; figures 1-3 * 



1,13,16 



TECHNICAL FIELDS 
SEARCHED (IM.C1.7) 



G02B 
H04N 



The present search report has been drawn up for all claims 



8 
S 

a. 

8 
8 
§ 

8 



Place of search 

Berl in 



Date of compleibn of the search 

19 May 2005 



Examiner 

Andreassen, J 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant if taken alone 

Y : particularly relevant if combined with another 

document of the same category 
A : technological background 
O : n on- written disclosure 
P . intermediate document 



T : theory or principle underlying the invention 
E : earlier patent document, but published on, or 

after the fifing date 
D : document cited in the application 
L : document cited for other reasons 

& : member of the same patent family, corresponding 
document 



37 



BNSOOCID: <EP 1566683A1 J_> 



EP 1 566 683 A1 



ANNEX TO THE EUROPEAN SEARCH REPORT 

ON EUROPEAN PATENT APPLICATION NO. EP G5 25 G759 



This annex lists the patent family members relating to the patent documents cited in the above-mentioned European search report. 
The members are as contained in the European Patent Office EDP file on 

The European Patent Office is in no way liable for these particulars which are merely given for the purpose of information. 

19-05-2005 



Patent document 
cited in search report 



Publication 
date 



Patent family 
member(s) 



Publication 
date 



EP 


0791847 


B 


27- 


-08- 


1997 


DE 


69718534 


Dl 


27-02-2003 












DE 


69718534 


T2 


06-11-2003 














EP 


0791847 


Al . 


27-08-1997 














JP 


9236777 


A 


09-09-1997 














US 


6064424 


A 


16-05-2000 


US 


2002011969 


Al 


31- 


-01- 


2002 


NONE 








WO 


9905559 


A 


04- 


-02- 


1999 


EP 


0934546 


Al 


11-08-1999 














WO 


9905559 


Al 


04-02-1999 














JP 


2001501073 


T 


23-01-2001 














US 


6801243 


Bl 


05-10-2004 



For more details about this annex : see Official Journal of the European Patent Office, No. 12/82 



38 



BNSDOCID: <EP. 



1566683A1_I_> 



